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Abstract 

We study an unbiased, discrete-time random walk on the nonnegative inte- 
gers, with the origin absorbing, and a history-dependent step length. Letting 
y denote the maximum distance the walker has ever been from the origin, 
steps that do not change y have length v, while those that increase y (taking 
the walker to a site that has never been visited), have length n. The process 
serves as a simplified model of spreading in systems with an infinite number of 
absorbing configurations. Asymptotic analysis of the probability generating 
function shows that, for large t, the survival probability decays as S(t) ~ t~ s , 
with 5 = v/2n. Our expression for the decay exponent is in agreement with 
results obtained via numerical iteration of the transition matrix. 

I. INTRODUCTION 

Random walks with absorbing and/or reflecting boundaries and/or memory serve as 
important models in statistical physics, often admitting an exact analysis. Among the 
many examples are equilibrium models for polymer adsorption [1,2] and absorbing-state 
phase transitions [3]. Another motivation is provided by the spreading of an epidemic in a 
medium with a long memory [4]. In this work we discuss a process where the susceptibility 
changes after the first infection and remains constant thereafter. 

In addition to the intrinsic interest of such an infection with memory, our study is 
motivated by the spread of activity in models exhibiting an infinite number of absorbing 
configurations, (INAC) typified by the pair contact process [5,6]. Anomalies in critical 
spreading for INAC, such as continuously variable critical exponents, have been traced to 
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a long memory in the dynamics of the order parameter, p, due to coupling to an auxiliary 
field that remains frozen in regions where p = [6,7]. INAC appears to be particularly 
relevant to the transition to spatiotemporal chaos, as shown in a recent study of a coupled- 
map lattice with "laminar" and "turbulent" states, which revealed continuously variable 
spreading exponents [8]. Grassberger, Chate and Rousseau [4] proposed that spreading in 
INAC could be understood by studying a model with a unique absorbing configuration, but 
in which the spreading rate of activity into previously inactive regions is different than for 
revisiting a region that has already been active. 

In light of the anomalies found in spreading in models with INAC or with a memory, we 
are interested in studying the effect of such a memory on the scaling behavior in a model 
whose asymptotic behavior can be determined exactly. Of particular interest is the survival 
probability S(t) (i.e., not to have fallen into the absorbing state up to time t). The simplest 
example of such a model is an unbiased random walk on the nonnegative integers, with the 
origin absorbing, for which S(t) ~ t~ 5 with 5 = 1/2. It was recently shown that such a walker 
exhibits a continuously variable exponent 5 when subject to a mobile, partial reflector. The 
latter is initially one site to the right of the walker. Each time the walker steps onto the site 
occupied by the reflector, it is reflected one step to the left with probability r (it remains 
at its new location with probability 1 — r); in either case, the reflector is pushed forward 
one site in this encounter. The survival exponent 5 = (l+r)/2 in this process [9]. Since 
the reflector effectively records the span of the walk (i.e., the rightmost site yet visited), its 
interaction with the walker represents a memory. 

In the present work, we study a random walk with memory of a different form: if the 
target site x lies in the region that has been visited before (that is, if x itself has been 
visited, or lies between two sites that have been visited), then the step length is v; otherwise 
the step length is n. If v > n, the random walk evolves in a hostile enviroment, while for 
v < n, the enviroment may be regarded as friendly. On the basis of an exact solution for 
the probability generating function, we obtain the decay exponent 5. 

The balance of this paper is organized as follows. In Sec. II we analyze the specific case 
of a random walk in a hostile enviroment with v — 2 and n — 1, present the solution of 
the generating function, and obtain the asymptotic behavior of the survival probability. In 
Sec. Ill we extend the analysis to arbitrary step lengths v and n (with v and n natural 
numbers). In Sec. IV we present exact numerical results for finite times (from iteration of 
the probability transfer matrix) that complement and extend the asymptotic analysis. Sec. 
V contains a brief summary and discussion. 

II. RANDOM WALK IN A HOSTILE ENVIROMENT 

A. Model and Generating Function 

Consider an unbiased, discrete time random walk on the nonnegative integers, with the 
origin absorbing. We denote the position of the walker at time t by x t and suppose that 
xq = 1. To define precisely the history dependence, let y t = max t {i t }. Then, if x t < yt — 2, 
the walker jumps two lattice spacings to the left or the right. If, however, x t = y t , it can 
move (with equal probability) to y t — 2, or to y t + 1. (In the latter case y t +i = yt + 1. Notice 
that yt~x t > must be even.) Let sites l,...,yt define the known region; steps to sites within 
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the known region have length two, while those that take the walker into the unknown region 
(x > yt) are of unit length. 

Evidently, the process x t is non-Markovian, since the transition probability into a given 
site depends on whether it lies in the known or the unknown region. We can however 
transform the model to a Markov process by enlarging the state space [10] to include the 
boundary between the two regions. Evidently, the stochastic process (x t ,yt) is Markovian. 
The transitions (all with probability 1/2) for the Markov chain are restricted to the set 
E C Z 2 specified by 

E = {(x, y) G Z 2 : x > —1, y > 1, x < y, y — x is even} 

as represented in Fig. 1. 

Let P(x,y,t) denote the probability of state (x,y) (for x > 0), at time t. P(x,y,t) 
follows the evolution equation 

P(x, y,t+l) = ^P(x + 2, y, t) + ^P(x - 2, y, t), for x < y, (1) 

with P(l,l,t) = 5 0j f Eq. (1) is subject to two boundary conditions. The first is the 
absorbing condition for x < 

P(x,y,t) = 0, fora;<0. (2) 

The second applies along the diagonal x = y. In this case, it is convenient to define D(y, t) = 
P(y,y,t). On the diagonal the evolution equation is 

D(y, t+l)= l -D(y-l,t) + ^P(y - 2, y, t), for y > 2. (3) 
To solve the problem specified by Eqs. (1) - (3), we introduce a generating function: 

oo 

P(x,y,z) = Y,P(x,y,t)z t , (4) 
t=o 

where < z < 1. Multiplying Eq. (1) by z l , summing over t and shifting the sum index 
where necessary, one finds that the generating function satisfies 

-P(x, y) = \P{x + 2, y) + \p{x - 2, y), ioix<y-A (5) 
Z A A 

-P(y -2,y) = \b{y) + \p{y - 4, y), for x = y - 2, (6) 

z A A 

(we drop the argument z for brevity), where t){y) is defined by an expression analogous to 
Eq. (4). The initial condition implies -D(l) = 1; the boundary conditions are 

P(x,y) = 0, fora;<0, (7) 

-D(y) = \b{y - 1) + \p{y - 2, y), for y > 2. (8) 

z A A 



3 



Next, we focus on Eq. (8) in order to eliminate D(y) in Eq. (6), and then find a 
recurrence relation for P(x,y). 

Substituting Eq. (6) in Eq. (8) we have 



(9) 



If we subtract z/2 times Eq. (9), evaluated at y — 1, from the corresponding equation for y, 
we find 



-(£)' 



D{y)--D{y-l) 



D{y-l)--D{y-2) 



+ 



+ l 2 



P(2/-4, J /)--P( J /-5,j/-l) 



Using Eq. (8) we eliminate D{y), D(y — 1) and D(y — 2) to obtain 



1 - 



P(y-2,y) = y P( y -3,y-l) + 



+ ^y\ i P(y-A,y)- Z -P(y-5,y-l) 



yielding the recurrence relation 
'A-z 2 



2z 



P(y -2,y)- P(y - 4, y) = P(y - 3, y - 1) - -P(y - 5, y - 1). 



(10) 



Eq. (5) relates P(x,y) for different x, at fixed y. We therefore impose separation of 
variables and write, for x < y — 2, 



Eq. (2) requires A(x) = for x < 0, which is satisfied if 



In this context, Eq. (5) implies: 



A 



\ x - X~ x , for x > 0, 
, for x < 0. 



1/2 



(11) 



(12) 



z \ z 



(13) 



(Note that use of the second solution, A_ = (z 1 — V-2~ 2 — l) 1 ^ 2 = A x , would simply result 
in a change in the sign of A.) Substituting Eq. (11) in Eq. (10) we find 



B{y) _ 2z My - 3) - z 2 A(y - 5) 
B(y - 1) (4 - z 2 ) A(y -2)-2z A(y - 4) 



(14) 
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B. The survival probability 



The survival probability is 



OO [ 2 J 



y=2 k=0 

where [ ] denotes the integer part of its argument. The corresponding generating function 
is: 



t=o 



= S P {z) + S D (z), 



(15) 



where S P {z) = £^ =2 £L ( =7 1)/21 Hv - 2k > v) and S D {z) = Y^= 2 D(y). We study these series 
separately. To begin, we insert Eq.(ll) in Sp to obtain 



OO L 2 J 

y=2 k=l 



(16) 



Next we examine So{z). Iterating Eq. (8), we have 
Summing Eq. (17) over y > 2 we find 



^=(2) ^- 2 ^ } - 



(17) 



S D {z) 



2-z 



l + J]i(y-2) £(y) 
y=2 



(18) 



C. Asymptotic analysis 

We address the Tauberian problem [11] of extracting the large-t asymptotics of S(t) from 
the dominant singularity of its generating function S(z), as z | 1- In order to study this 
limit, let z — 1 — e, with e J, 0. We will show that as £ — > oo, the dominant contribution to 
the survival probability comes from Sp(z). 

To determine the asymptotic behavior of Sp, we analyze B(y) and the sum 
EEi^ 2 ' A(y — 2k) separately. First, we focus on B; in light of Eq. (14), it is convenient 
to write, 

6 ® = 6 ®fl& (19) 



fc=4 
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/From Eq. (11) we have 5(3) = P(l,3) / A(l), with A(l) ~ V2e, as e | 0. (We use the 
symbol "~" to indicate asymptotic equality as e j 0.) On the other hand, Eq. (8) implies 
that P(l,3) = ? £)(3) - £)(2), where Z>(2) = z/2. Iterating Eq. (3) we have 



D(3,t) 



, if t is odd 
, if t is even 



so that D(3) = 2z / (4 - ^ 2 ). Evidently, P(l, 3) ~ |, as e J, 0, and therefore 

S(3) 



6^' 



The ratio B(k)/B(k - 1) may be analyzed by inserting Eq. (12) in Eq. (14) 

B(k) _ \ k (2z\~ 3 -z 2 \~ 5 )-\~ k (2z\ 3 -z 2 \ 5 ) 
B(k-l) ~ A fe [(4 - z 2 )\- 2 - 2z\~ 4 ] - \~ k [(4 - z 2 )\ 2 - 2z\ 4 } 

For small e, A = 1 + + 0(e). Then, 

B(k) \ k - \~ k - \V2e{\ k + \- k ) 



B(k - 1) X k - \~ k + V2e(A fe + \- k ) 
Now, letting A = ln(A), we have 

B{k) ^ tanh(^jfc)-iy^i 
B(k - 1) ~ tanh ( *f fc) + v 7 ^ ' 



Letting fc = tanh (^^j, this yields, 



fc=4 



B(k-1) 



* 1 



Approximating the sum by an integral, we have 



y i 
X" 



fc=4 



0fc v 7 ^ Av^i tanh(w) 



fc=4 



2e 



In 



sinh ( 



sinh (2y/2e) 



and hence, 



l = { B(k - 1) S i n h 3 



C 



3 
£2 



(20) 



(21) 
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where C is a constant. Inserting Eqs. (20) and (21) in Eq. (19) we find, 

B(V) -f^r- (22) 

sinh 3 ( ±fy) 

(By "~" we mean asymptotic proportionality as e j 0, i.e., multiplicative constants are 
ignored.) Finally, we note that as e | 0, 



J2 Mv - 2A;) ~ l 2 ^J ~ e-a sinh 2 ^—y J . (23) 

With these results, we are in a position to analyze the asymptotic behavior of Sp and Sd- 
First, we determine the asymptotic behavior of Sp(z). Substituting Eqs. (23) and (22) 
in Eq. (16) we find 

i » sinh 2 i^fy) 

Sp ~ £2 > ) f . 

^ sinh 3 (af y) 

Denoting the sum by H(e), we have 



^ sinh (w) 

Let us denote the integrand by f(w) and the integral by /(e). Since f(w) has a pole of order 
1, we introduce the Laurent expansion 



f(w) = jw 1 + ^a k w k 



k=0 

and integrate the series term by term. Noting that the dominant contribution, as e j 0, 
comes from the first term, we have 

If 1 1 

/(e) — - I w' 1 dw ~ — - ln(e). 

Thus, 

Sp ~ — ln(e). 

Using the same line of reasoning, it can be shown lim^o Sd/ 'Sp = 0. Therefore, the dominant 
singular behavior of S as z | 1 is given by: 

S(z) ~ -ln(l-z). 

The coefficient of in the expansion of — ln(l — z) is i -1 , and so the survival probability 
decays asymptotically as 
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III. ARBITRARY STEP LENGTHS 



In this section, we generalize the analysis of Sec. II to a walker with an arbitrary 
history-dependent step length. Let v be the step length for target sites in the known region, 
and n the step length in case the target site lies in the unknown region. We consider the 
Markov chain (xt, yt), with y t as defined in Sec. II and transitions with probability 1/2. The 
probability P(x, y, t) follows the equation 

1 1 

P(x,y,t+l) = -P(x + v,y,t) + -P(x-v,y,t), hvx<y, (24) 

with P(l,l,t) = S t fi- Eq. (24) is subject to two boundary conditions, the first, Eq. (2), 
is due to the absorbing condition. The second applies along the diagonal x — y. Defining 
D(y,t) = P(y,y,t), as before, we have 

D(y, t + l) = ±D(y-n,t) + ^P(y -v,y,t), for y > n + 1. (25) 

Introducing the generating functions P(x,y) and D(y) as in Sec. II, one readily finds, 

-P(x,y) = ]-P(x + v,y) + -P(x-v,y), forx<y-2v, (26) 
z Z Z 

1 „ 1 , 1 , 

-P(y - v,y) = -D(y) + -P(y - 2v,y), ioYx = y-v. (27) 

z z z 

The initial condition is D(l) = 1, and the boundary conditions are 

P(x,y) = 0, fora;<0 (28) 

±D(y) = ±D(y-n) + ^P(y-v,y), iovy>n+l. (29) 

Proceeding as in Sec. II, one finds the recurrence relation: 
~4-z 2 ~ 



2z 



P(y -v,y)- P(y - 2v, y) = P(y -v - n,y - n) - -P(y - 2v - n, y - n). (30) 



The solution for P(x,y) is again of the form of Eq. (11), with A again given by Eq. (12), 
but with, 

l/v 



With this, one readily finds, 

B(y) _ 2zA(y-v-n)- z 2 A(y - 2v - n) 
B(y -n) (4 - z 2 ) A(y - v) - 2z A(y - 2v) 

Since y = nj + 1 and x — y — vk — nj — vk + 1, S(z) is given by 



(31) 
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oo L 
j=l k=0 



(32) 



where L — \-p\- We define 



oo L 

s P (z) = J2J2 p ( n i- vk + 1 > n -? + 1 ) 

j=l k=l 
oo L 

= J2Y1 A-inj -vk + l) B{nj + 1) 

3=1 k=l 



(33) 



and 



S D {z) =Y,D(nj + l). 

3=1 



Iterating Eq. (29) we find 



D(nj + 1) = + J2(^Y ^ "Hnk-v + l,nk + l). 



z \j+l-k 



(34) 



k=i 



Summing Eq. (34) over y > n+1, and inserting the expressions found previously for P(x, y), 
we have 



Sd(z) 



2-z 



1 + ^ M n 3 -v + 1) B(nj + 1) 

3=1 



(35) 



In order to determine the asymptotic behavior of Eqs. (33) and (35), we analyze A, B 
and the sum J2k=i A{nj — vk + l) separately. First, we write B in the form: 



(36) 



where k is the smallest positive integer such that the argument of A(x) is positive. Note 
that 



B(nk + 1) ~ Ci(v,n, k ) e 2 , 



(37) 



with Ci(v,n, k ) a coefficient which depends on v, n and k . The ratio B(y)/B(y — n) may 
be written, 

B{y) \y{2z\- v - n - z 2 \- 2v - n ) - \-y{2z\ v+n - z 2 \ 2v+n ) 



B( y - n ) A»[(4 - z 2 )\~ v - 2z\- 2 '"} - \-v[(4 - z 2 )X v - 2z\ 2v \ ' 
For small e, A ~ 1 + \\f2e, and 
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B{y) \ y - \~ y - ^V2e(X y + \~ y ) 



B(y -n) \ y - \- y + V2e(Af + A~») 
As before, let A = ln(A). Then, 

B(y) ^ tanh(^y)-gv^ 
B(y-n) tan h^vji^ +v ^ 

A calculation analogous to that leading to Eq. (22) then yields, 

V 

€ 2 » 



B(nj + 1) ~C 2 (v,n, k ) 



sinh 1+ " 



(38) 



with C 2 (f,n, k ) a coefficient which depends on v, n and k . Finally, we note that as e j 0, 



^2A(nj -vk + 1) 



k=i 



e 2 sinh 2 



*2e 



2w 



(raj + 1) 



(39) 



With these results, we are in a position to analyze the asymptotic behavior of Sp and So- 
First, we determine the asymptotic behavior of Sp(z). Substituting Eqs. (39) and (38) 
in Eq. (33) we find 



i 00 sinh 2 
Sp ~ e^r _ 2 — 



=i sinh 



^(nj + 1) 



As before, we approximate the sum, denoted H(e), by an integral, 



H(e) 



'1/2 



n 



V2 



r°° si 

Joe 1 / 2 Si 



sinh 2 (|u>) 



ge i/2 sinh 1+ ™ (u>) 



dw, 



with g = ( 1+n ) v/ ^ - L e t us denote the integrand by f(w) and the integral by /(e). First, note 
that if v < n, then f(w) is bounded, and 1(e) converges. Therefore, 



Sp ~ e 2 ™ 



-l 



for v < n. 



On the other hand, if v > n, then f(w) diverges as w j and decays exponentially for 
w >> 1. In particular, if ^ = 2m, with m = 1,2,3, .. ., then f(w) has a pole of order m. 
Introducing the Laurent expansion 



f( w ) = ^2 afe ( m ) wk + &fc ( m ) w 



fe=0 



fe=l 



and integrating the series term by term, we note that the dominant contribution to Sp, as 
e | 0, comes from the term proportional to w^ 1 . Thus, 
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/(e) ~ bi(m) / w 1 dw ~ —bi{m) ln(e). 

Jqe 1 / 2 

Since 61 (m) is the residue of f(w) at w — 0, we may relate it to an integral around a closed 
contour containing the origin in the complex-w plane. In this manner we can establish the 
recurrence relation: 

him) = ~ Mm -i)-b 1 (m-2) + b 1 (m-3)-... + (-l) m 36i(l)] , 
2m 

where 61 (1) = 1/4, as found in Sec. II. Observe that the bi(m) alternate in sign. Thus, 

Sp ~ (—1)2^ ei^ -1 ln(e), for v = 2mn. 

Using the same line of reasoning, it can be shown that if n < v 7^ 2mn, then Sp ~ e^ -1 . 
Moreover, lim e ^ Sp>/Sp = 0. Therefore, the dominant singular behavior of S as z j 1 is 
given by: 

{(— 1) 2^ (1 — z)^' 1 ln(l — z) , for t> = 2n, 4n, 6n, . . ., 
(1 — z)2n 1 , otherwise. 

The coefficient of z l (for large t) in the expansion of (— 1)^ (1— z)^" 1 ln(l— z) is proportional 
to t~2^ and therefore the survival probability decays asymptotically as t~2^, for v = 2mn. 
On the other hand, since the coefficient of z l (for large t) in the expansion of (1 — z) a 
is proportional to t~ & , with 5 = 1 + a, we conclude that the survival probability decays 
asymptotically as t~ v ^ 2n , for v 7^ 2m n as well. Thus, we have S(t) ~ t^^r for arbitrary step 
lengths f and n, which is the result we set out to prove. 



IV. NUMERICAL RESULTS 

In this section we report exact numerical results for finite times (t < 10 4 ) from iteration 
of the discrete time evolution equations. Consider first the hostile enviroment. Iteration 
of Eq. (1), subject to the boundary conditions of Eqs. (2) and (3), yields the survival 
probability, S(t), as shown in Fig. 2. Evidently, S(t) approaches the asymptotic value, 
2/t, at long times. It is interesting to examine the mode of approach to this scaling limit; 
assuming a power-law correction to scaling term, we write 

+ (40) 

so that the dominant correction to scaling ~ t~^ l+ ^ . If this form is correct, then at long 
times lnln[tS'(t)/2] ~ C — (pint, where C is a constant. Our results confirm the assumed 
correction to scaling and yield an exponent of 0=1 (see Fig. 2, inset). 

We have also analyzed, via iteration, the step-length combinations listed in Table I. 

In all cases, the predicted value of 5 is confirmed, and the correction to scaling exponent 
is unity. We have also verified numerically that, in all the cases studied, the mean position, 
conditioned on survival (x) s ~ t 1 / 2 and that (x 2 ) s ~ t, as is to be expected. 
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V. DISCUSSION 



We have studied the asymptotic survival probability of a random walker on the one- 
dimensional lattice, with the origin absorbing, and with a step-length that depends on 
whether the target site lies within the region that has been visited before. In all cases studied, 
we find that the survival probability decays asymptotically as a power law, S(t) ~ t~ s , where 
5 = v/2n. Our expression for the decay exponent is in agreement with results obtained via 
numerical iteration of the transition matrix. 
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TABLES 



V 


n 


5 


1 


2 


1/4 


2 


3 


1/3 


3 


2 


3/4 


3 


1 


3/2 


4 


1 


2 



TABLE I. Step lengths studied via iteration 
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Figure Captions 



Fig. 1. Random walk in a hostile enviroment: transitions in the x-y plane. 

Fig. 2. Main graph: decay of survival probability in the hostile model with v — 2 and n — 1; 
the equation of the solid line is S = 2/t. Inset: A = In [In (2/t) — lnS'(t)] versus lnt; the 
slope of the straight line is = —1. 
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